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Abstract. For the paradigmatic case of the damped quantum harmonic oscillator 
we present two measurement-based feedback schemes to control the stability of its 
fixed point. The first scheme feeds back a Pyragas-like time-delayed reference sig¬ 
nal and the second uses a predetermined instead of time-delayed reference signal. 
We show that both schemes can reverse the effect of the damping by turning the 
stable fixed point into an unstable one. Finally, by taking the classical limit h —> 0 
we explicitly distinguish between inherent quantum effects and effects, which would 
be also present in a classical noisy feedback loop. In particular, we point out that 
the correct description of a classical particle conditioned on a noisy measurement 
record is given by a non-linear stochastic Fokker-Planck equation and not a Langevin 
equation, which has observable consequences on average as soon as feedback is con¬ 
sidered. 


1 Introduction 

Continuous variable quantum systems are quantum systems whose algebra is 
described by two operators x and p (usually called position and momentum), 
which obey the commutation relation [x,p] = ih. Such systems constitute an 
important class of quantum systems. They do not only describe the quantum 
mechanical analogue of the motion of classical heavy particles in an external 
potential, but they also arise, e.g., in the quantization of the electromagnetic 
field. Understanding them is important, e.g., in quantum optics [1], for pur¬ 
poses of quantum information processing [2, 3], or in the growing field of 
optomechanics [4]. Furthermore, due to the pioneering work of Wigner and 
Weyl, such systems have a well-defined classical limit and can be used to 
understand the transition from the quantum to the classical world [5]. 

To each quantum system there is an operator associated, called the Hamil¬ 
tonian H , which describes its energy and determines the dynamics of the sys¬ 
tem if it is isolated. However, in reality each system is an open system, i.e., it 
interacts with a large environment (we call it the bath). Since the bath is so 
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large that we cannot describe it in detail, it induces effects like damping, dis¬ 
sipation or friction, which will eventually bring the system to a steady state. 
Classically as well as quantum mechanically it is often important to be able 
to counteract such irreversible behaviour, for instance, by applying a suitably 
designed feedback loop. 

In the quantum domain, however, feedback control faces additional chal¬ 
lenges compared to the classical world [6], see also Fig. 1. Each closed loop 
control scheme starts by measuring a certain output of the system and tries 
to feed the so gained information back into the system by adjusting some sys¬ 
tem parameters to influence its dynamics. In the quantum world - due to the 
measurement postulate of quantum mechanics and the associated “collapse of 
the wavefunction” the measurement itself significantly disturbs the system 
and thus, it already influences the dynamics of the system. If one does not 
take this fact correctly into account, one easily arrives at wrong conclusions. 
Nevertheless, beautiful experiments have shown that quantum feedback con¬ 
trol is invaluable to protect quantum information and to stabilize non-classical 
states of light and matter in various settings, see e.g. Refs. [7, 8, 9, 10, 11, 12] 
for a selection of pioneering work in this field. 


quantum system 



classical 

controller 


Fig. 1. Generic sketch for a closed-loop feedback scheme, in which we wish to control 
the dynamics of a given quantum system. Note that the feedback loop itself is actu¬ 
ated by a classical controller, i.e., the information after the measurement is classical 
(it is a number and not an operator). Nevertheless, to obtain the correct dynamics 
of the quantum system one needs to pay additional attention to the measurement 
and feedback step. 


In this contribution we will apply two measurement based control schemes 
to a simple quantum system, the damped harmonic oscillator (HO), by cor¬ 
rectly taking into account measurement and feedback noise at the quantum 
level (Sec. 3 and 4). These schemes will reverse the effect of dissipation and 
- to the best of our knowledge - have not been considered in this form else¬ 
where. However, we will see that our treatment is conceptually very close to 
a classical noisy feedback loop. With this contribution we thus also hope to 
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provide a bridge between quantum and classical feedback control. For peda¬ 
gogical reasons we will therefore first present the necessary technical ingre¬ 
dients (continuous quantum measurement theory, quantum feedback theory 
and the phase space formulation of quantum mechanics) in Sec. 2. Due to a 
limited amount of space we cannot derive them here, but we will try to make 
them as plausible as possible. Sec. 5 is then devoted to a thorough discussion 
of the classical limit of our results showing which effects are truly quantum 
and which can be also expected in a classical feedback loop. In the last sec¬ 
tion we will give an outlook about possible applications and extensions of our 
feedback loop. 


2 Preliminary 

2.1 The damped quantum harmonic oscillator 

We will focus only on the damped HO in this paper, but we will discuss ex¬ 
tensions and applications of our scheme to other systems in Sec. 6. Using a 
canonical transformation we can rescale position and momentum such that 
the Hamiltonian of the HO reads H = u(p 2 + x 2 )/ 2 with [x,p\ = ih. Introduc¬ 
ing linear combinations of position and momentum, called the annihilation 
operator a = (x + ip)/V2H and its hermitian conjugate, the creation operator 
a', we can express the Hamiltonian as H = Hoj(a'a + 1/2). Note that we 
explicitly keep Planck’s contant h to take the classical limit (H 0) later on. 

The state of the HO is described by a density matrix p, which is a positive, 
hermitian operator with unit trace: trp = 1. If the HO is coupled to a large 
bath of different oscillators at a temperature T, it is possible to derive a 
so-called master equation (ME) for the time evolution of the density matrix 
[1, 6, 13]: 

= ~^[H,p(t)\ + n{l + n B )V[a}p{t) + nn B T>[a^]p{i). (1) 

Here, we introduced the dissipator 23, which is defined for an arbitrary oper¬ 
ator 6 by its action on the density matrix: D[o\p = opo t — {c^b, p}/2 where 
{a, b} = ab + ba denotes the anti-commutator. Furthermore, k > 0 is a 
rate of dissipation characterizing how strong the time evolution of the sys¬ 
tem is effected by the bath and n B denotes the Bose-Einstein distribution, 
n B = (e^ hul — l)” 1 , where /? = 1/T is the inverse temperature (we set k B = 1). 
For later purposes we abbreviate the whole ME (1) by 

-^p(f) = C a p(t), (2) 

where the “superoperator” Co is often called the Liouvillian and the subscript 
0 refers to the fact that this is the ME for the free time evolution of the 
HO without any measurement or feedback performed on it. Furthermore, it 
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will turn out to be convenient to introduce a superoperator notation for the 
commutator and anti-commutator: 


C[d\p=[d,p\, A[o]p= {b,/3}. 


(3) 


One easily verifies that the time evolution of the expectation values of 
position ( x)(t ) = tr{x/5(t)} and momentum (p)(t) = tr {pp(t)} is 


^{x)(t) = u(p)(t) - ^(x){t), 

= -w(ir)O) - p)(t ), 


(4) 


as for the classical damped harmonic oscillator. More generally speaking, for 
an arbitrary dynamical system these equations describe the generic situation 
for a two-dimensional stable steady state ( x*,p *) = (0,0) within the linear 
approximation around (0,0). For k < 0 this would describe an unstable steady 
state, but physically we can only allow for positive n. The positivity of k is 
mathematically required by Lindblad’s theorem [14, 15] to guarantee that Eq. 
(1) describes a valid time evolution of the density matrix. 1 

Finally, a reader unfamiliar with this subject might find it instructive to 
verify that the canonical equilibrium state 


Peq ~ ~ e -ptiuaia 


(5) 


is a steady state of the total ME (1) as it is expected from arguments of 
equilibrium statistical mechanics. 


2.2 Continuous quantum measurements 

In introductory courses on quantum mechanics (QM) one only learns about 
projective measurements, which yield the maximum information but are also 
maximally invasive in the sense that they project the total state p onto a sin¬ 
gle eigenstate. QM, however, also allows for much more general measurement 
procedures [6]. For our purposes, so-called continuous quantum measurements 
are most suited. They arise by considering very weak (i.e., less invasive) mea¬ 
surements, which are repeatedly performed on the system. In the limit where 
the time between two measurements goes to zero and the measurement be¬ 
comes infinitely weak, we end up with a continuous quantum measurement 
scheme. For a quick introduction see Ref. [16]. Using their notation, one needs 
to replace k K > ^/(Ah) to obtain our results. 

1 The situation of an unstable fixed point would be modeled by exchanging the 
operators a and a' in the dissipators. This would correspond to a negative k 
in the equation for the mean position and momentum. The feedback schemes 
presented here also work in that case. 
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For our purposes we want to continuously measure (or “monitor”) the 
position of the HO. Details of how to model the system-detector interaction 
can be found elsewhere [17, 18, 19, 20, 21]. Here, we restrict ourselves to 
showing the results and we try to make them plausible afterwards. If we 
neglect any contribution from £o for the moment, the time evolution of the 
density matrix due to the measurement of x is [6, 16, 17, 18, 19, 20, 21] 

d 

-Q t P{t) = -C 2 [x\p(t) = CmeasP{t)- (6) 

Here, the new parameter 7 has the physical dimension of a rate and quantifies 
the strength of the measurement. For 7 = 0 we thus recover the case without 
any measurement. It is instructive to have a look how the matrix elements 
of p(t) evolve in the measurement basis \x) of the position operator x = 
J dxx\x){x\: 

^(x\p(t)\x') = -^(x - x') 2 {x\p{t)\x'). (7) 

We thus see that the off-diagonal elements (or “coherences”) are exponentially 
damped whereas the diagonal elements (or “populations”) remain unaffected. 
This is exactly what we would expect from a weak quantum measurement: the 
density matrix is perturbed only slightly but finally, in the long-time limit, it 
becomes diagonal in the measurement basis. Note that in case of a standard 
projective measurement scheme, the coherences would instantaneously vanish. 

The ME (6) is, however, only half of the story, because it tells us only 
about the average time evolution of the system, i.e., about the whole en¬ 
semble p averaged over all possible measurement records. The distinguishing 
feature of closed-loop control (as compared to open-loop control) is, however, 
that we want to influence the system based on a single (and not ensemble) 
measurement record. We denote the density matrix conditioned on a certain 
measurement record by p c and call it the conditional density matrix. Its clas¬ 
sical counterpart would be simply a conditional probability distribution. 

In QM, even in absence of classical measurement errors, each single mea¬ 
surement record is necessarily noisy due to the inherent probabilistic inter¬ 
pretation of measurement outcomes in QM. The measurement signal I(t) as¬ 
sociated to the continuous position measurement scheme above can be shown 
to obey the stochastic process [6, 16] 


d,I(t) = {x) c (t)dt + J-^—dW{t). (8) 

V 2 7?7 

Here, by {x) c {t) we denoted the expectation value with respect to the con¬ 
ditional density matrix, i.e., ( x) c (t ) = tr {xp c (t)}. Furthermore, dW(t) is the 
Wiener increment. According to the standard rules of stochastic calculus, it 
obeys the relations [6, 16] 

E [dW{t)\ = 0, dW(t ) 2 = dt 


(9) 
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where E[... ] denotes a (classical) ensemble average over all noisy realizations. 
Furthermore, we have introduced a new parameter 77 £ [0,1], which is used to 
model the efficiency of the detector [ 6 , 16, 20 ] with 77 = 1 corresponding to 
the case of a perfect detector. 

Finally, we need to know how the state of the system evolves conditioned 
on a certain measurement record. This evolution is necessarily stochastic due 
to the stochastic measurement record. The so-called stochastic ME (SME) 
turns out to be given by [ 6 , 16] 

p c {t + dt) = p c (t) + £ meajS p c (t)dt + ^j^A[x - (x) c (t)\p c (t)dW{t). (10) 

Because it will turn out to be useful, we have written the SME in an “incre¬ 
mental form” by explicitly using differentials as one would also do for numer¬ 
ical simulations. By definition we regard the quantity [ p c (t + dt) — p c (t)]/dt 
as being equivalent to d t p c (t). Using Eq. ( 8 ) we can express the SME alter¬ 
natively as 

p c (t+dt) = p c {t)+C meas p c (t)dt+^-A[x-(x) c (t)]p c (t)[dI(t)-{x) c (t)dt], (11) 

which explicitly demonstrates how our knowledge about the state of the sys¬ 
tem changes conditioned on a given measurement record I(t ). 2 We remark 
that the SME for p c {t ) is nonlinear in p c (t), due to the fact that this in an 
equation of motion for a conditional density matrix. 

To obtain the ME ( 6 ) for the average evolution, we only need to average 
the SME (10) over all possible measurement trajectories. In fact, it can be 
shown (see [ 6 , 16]) that Eq. (10) has to be interpreted within the rules of 
Ito stochastic calculus (as well as all the following stochastic equations unless 
otherwise mentioned) such that 


E \p c (t)dW(t)] = E[p c (t)]E[dW(t)] = 0 (12) 


holds. Defining p{t) = E[p c (f)], one can readily verify that the SME (10) yields 
on average Eq. ( 6 ). 

Taking the free evolution of the HO into account, Eq. (1), the total stochas¬ 
tic evolution of the system obeys 


p c (t + dt) 


11 + (£0 + U me as) dt + 



(x) c {t)]dW{t)^ p c (t). (13) 


Note that there are no “mixed terms” from the free evolution and the evolution 
due to the measurement to lowest order in dt. Furthermore, we remark that a 
solution of a SME is called a quantum trajectory in the literature [ 6 , 13, 22]. 

2 We explicitly adopt a Bayesian probability theory point of view in which proba¬ 
bilities (or more generally the density matrix p) describe only (missing) human 
information. Especially, different observers (with possibly different access to mea¬ 
surement records) would associate different states p to the same system. 
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2.3 Direct quantum feedback 


In the following we will consider a form of quantum feedback control, which is 
sometimes called direct quantum feedback control, because the measurement 
signal is directly fed back into the system (possibly with a delay) without 
any additional post-processing of the signal as, e.g., filtering or parameter 
estimation [21]. Direct quantum feedback based on a continuous measurement 
scheme was developed by Wiseman and Milburn [23, 24, 25]. Experimentally, 
the idea would be to continuously adjust a parameter of the Hamiltonian 
based on the measurement outcome (8) to control the dynamics of the system. 
Theoretically, we define the feedback control superoperator T 

\Pc(t)]n> = W) = -L*Mc[z]ji c (t), (14) 


which describes a change of the free system Hamiltonian H = w(p 2 + x 2 )/2 
to a new effective Hamiltonian w(p 2 + x 2 )/2 + dI ^ z containing a new term 
proportional to the measurement result and an arbitrary hermitian operator z 
(with units of x). Here, we neglected any delay and assumed an instantaneous 
feedback of the measurement signal, but a delay can be easily incorporated, 
too, see Sec. 3. 

Because the action of the feedback superoperator T on the system was 
merely postulated, we do not a priori know whether we have to interpret it 
according to the Ito or Stratonovich rules of stochastic calculus, but it turns 
out that only the latter interpretation gives senseful results [6, 23, 24]. Then, 
the effect of the feedback on the total time evolution of the system (including 
the measurement and free time evolution) can be found by exponentiating Eq. 
(14) [6, 23, 24] 


p c (t + dt) = < 1 + Codt + C 



'H[x)dW{t)\ p c {t) (15) 


and this equation is again of Ito type. Note that by construction this equation 
assures that the feedback step happens after the measurement as it must due 
to causality. Now, expanding e™ to first order in dt with dl(t) from Eq. (8) 
(note that this requires to expand the exponential function up to second order 
due to the contribution from dW(t) 2 = dt) and using the rules of stochastic 
calculus gives the effective SME under feedback control: 


p c {t + dt) 


p c (t) + dt j£o+£ m ea S - ^ : C[z]A[x ] - ^^C 2 [I] j p c (t) 

f ^ • r— y \ ( 16 ) 

+ dW(t) j ^ {x)c(t)] - jJ J 1 


If we take the ensemble average over the measurement records, we obtain the 
effective feedback ME 
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or more explicitly for our model 



+ re(l + nB)T>[a\p(t) + KriB'D[a)]p{t) 


(18) 



Note that this equation is again linear in p(t) as it must be for a consistent 
statistical interpretation. 

Before we give a short review about the last technically ingredient we need, 
which is rather unrelated to the previous content, we give a short summary. 
We have introduced the ME (1) for a HO of frequency w, which is damped at 
a rate k due to the interaction with a heat bath at inverse temperature /3. We 
then started to continuously monitor the system at a rate 7 with a detector of 
efficiency p. This procedure gave rise to a SME (13) conditioned on the mea¬ 
surement record ( 8 ). Finally, we applied feedback control by instantaneously 
changing the system Hamiltonian using the operator z, which resulted in the 
effective ME (17). 

2.4 Quantum mechanics in phase space 

The phase space formulation of QM is an equivalent formulation of QM, in 
which one tries to treat position and momentum on an equal footing (in 
contrast, in the Schrodinger formulation one has to work either in the position 
or (“exclusive or”) momentum representation). By its design, phase space QM 
is very close to the classical phase space formulation of Hamiltonian mechanics 
and it is a versatile tool for a number of problems. For a more thorough 
introduction the reader is referred to Refs. [1, 5, 22, 26, 27, 28]. 

The central concept is to map the density matrix p to an object called the 
Wigner function: 



(19) 


The Wigner function is a quasi-probability distribution meaning that it is 
properly normalized, f dxdpW(x,p) = 1, but can take on negative values. The 
expectation value of any function F(x,p) in phase space can be computed via 



( 20 ) 


where the associated operator-valued observable f(x,p) can be obtained from 
F(x,p) via the Wigner-Weyl transform [5, 22, 28]. Roughly speaking this 
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transformation symmetrizes all operator valued expressions. For instance, if 
F(x,p) = xp 1 then f(x,p) = (xp + px)/ 2. 

Each ME for a continuous variable quantum system can now be trans¬ 
formed to a corresponding equation of motion for the Wigner function. This 
is done by using certain correspondence rules between operator valued expres¬ 
sions and their phase space counterpart, e.g., 

z/3-B- + W(x,p), (21) 

which can be verified by applying Eq. (19) to xp and some algebraic manip¬ 
ulations [22, 27]. 

The big advantage of the phase space formulation of QM is now that many 
MEs (namely those which can be called “linear”) transform into an ordinary 
Fokker-Planck equation (FPE), for which many solution techniques are known 
[29]. We denote the general FPE for two variables ( x,p ) as 

^W(x,p,t) = j-V T • d + iv T • D ■ V J W(x,p,t) (22) 


where V T = (d x ,d p ), the dot denotes a matrix product, d is the drift vector 
and D the diffusion matrix. It is then straightforward to confirm that the ME 
(1) corresponds to a FPE with 


A K A K 

d x =up- —x, d p = —ux - -p, 


Dxx — Dpp — kH- 


V 

1 + 2 riB 


F)x P F) px 0. 


(23) 


The SME (10) instead transforms to an equation for the conditional Wigner 
function W c (x,p,t) and reads 


W c (x,p,t + dt) 


1 H- dt 


7 h d 2 


dW{t) 



<*)c] 


W c (x,p,t). (24) 


This does not have the standard form of a FPE. The additional term, how¬ 
ever, does not cause any trouble in the interpretation of the Wigner function 
because we can still confirm that f dxdpW c (x,p,t ) = 1. 

Finally, we point out that the transition from quantum to classical physics 
is mathematically accomplished by the limit h —> 0 [5]. Physically, of course, 
we do not have h = 0 but the classical action of the particles motion becomes 
large compared to h. We will discuss the classical limit of our equations in 
detail in Sec. 5. 


3 Feedback Scheme I 

The first feedback scheme we consider is the quantum analogue of the classical 
scheme considered in Ref. [30] . There the authors used a time delayed reference 
signal of the form (without any noise) 
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SI(t, t) = [I(t) — I(t — r)]dt 


= [(x)(t) - {x) T (t)]dt + 

to control the stability of the fixed point. 3 Here, a subscript r indicates a 
shift of the time argument, i.e., f T (t) = — Due to this special form such 

feedback schemes are sometimes called Pyragas-like feedback schemes [33] . It 
should be noted however that we do not have a chaotic system here and we do 
not want to stabilize an unstable periodic orbit. In this respect, our feedback 
scheme is still an invasive feedback scheme, because the feedback-generated 
force does not vanish even if our goal to reverse the effect of the damping was 
achieved. We emphasize that such feedback schemes are widely used in classi¬ 
cal control theory to influence the behaviour of, e.g., chaotic systems or com¬ 
plex networks [34, 35] and quite recently, there has been also a considerable 
interest to explore its quantum implications [36, 37, 38, 39, 40, 41, 42, 43]. 
However, except of the feedback scheme in Ref. [41], the feedback schemes 
above were designed as all-optical or coherent control schemes, in which the 
system is not subjected to an explicit measurement, but the environment is 
suitable engineered such that it acts back on the system in a very specific way. 
We will compare our scheme (which is based on explicit measurements) with 
these schemes towards the end of this section. 

To see how our feedback scheme influences our system, we can still use Eq. 
(15) together with the measurement signal (25). Choosing z = kp with fcel 
and using that d.W(t)dW T (t) = 0 for r / 0 we obtain the SME 


l — {dW(t)-dW T (t)] 


(25) 


Pc(t + dt ) — {1 + dt[C o + £meas]} Pc{t ) 

f ik ik h 2 1 

- dt{-C\p]A[x - (x) c (t)} -[<£)(*) - (x) T (t)m ~ C 2 \P\) Pc(t) 

+ dW ^)\j\ ( x) c (t)\p c (t ) - jh— {dW(t) - dW T (t)]C\p\p c {t). 

(26) 


It is important to emphasize that also time-delayed noise enters the equation 
of motion for p c (t). Because we do not know what E{p c (t)dW T (t)\ is in general, 
there is a priori no ME for the average time evolution of p{t). Approximating 
E [p c (t)dW T (t)\ ~ 0 yields nonsense (the resulting ME would not even be linear 
in p). This is, however, not a quantum feature and is equally true for classical 
feedback control based on a noisy, time-delayed measurement record (also see 
Sec. 5). 

3 In fact, in Ref. [30] they did not only feed back the results from a position mea¬ 
surement, but also from a momentum measurement. The simultaneous weak mea¬ 
surement of position and momentum can be also incorporated into our framework 
[17, 31, 32], but this would merely add additional terms without changing the 
overall message. 
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Due to the fact that there is no average ME, we are in principle doomed 
to simulated the SME (26) and average afterwards. However, as it turns out 
Eq. (26) can be transformed into a stochastic FPE whose solution is expected 
to be a Gaussian probability distribution. We will then see that the covari¬ 
ances indeed evolve deterministicly. Furthermore, it is possible to analytically 
deduce the equation of motion for the mean values on average. Within the 
Gaussian approximation we then have full knowledge about the evolution of 
the system. 

Using the results from Sec. 2.4 we obtain 


W c (x,p , t + dt) = W c (x,p, t) + dt ( — V T • d + -V T ■ D • V ) W c (x,p, t) 


2l ^dW(x - (x) c ) - kJ^(dW - dW T )^~ \ W c {x,p, t) 


27*7 


with the nonvanishing coefficients 


d x =u>p- ^x + k[x - (x) CjT (f)], d p = -u>x - ^ p , 

D - nh l + 2nB | Hk2 D - nh 1 + 2nB I ^ 
— ri'lL “T , J-spp — rvll' 0 ' n ’ 

2 777 2 2 


(27) 

(28) 
(29) 


We introduce the conditional covariances by 


V x , c = (x 2 ) c - ( x)\ 


V p , c = ( P 2 )c ~ (p)c, C'c = (xp) c ~ {x) c {p)c (30) 


where we dropped already any time argument for notational convenience (we 
keep the subscript r to denote the time-delay though). The time-evolution of 
the conditional means is then given by 

d(x) c = {u{p) c -^{x) c + k({x) c -{x) CT )}dt (31) 

+ k^idW - dW T ) + J^Lv x , c dw, 

d(p)c = [~u{x) c - |(p)c} dt + \f^ CcdW ( 32 ) 

Note that - for a stochastic simulation of these equations - we are required to 
simulate the equations for the covariances [Eqs. (35) - (37)], too. Interestingly 
however, because the time-delayed noise enters only additively, we can also 
average these equations to obtain the unconditional evolution of the mean 
values directly: 

j t {x) = w(p) - |(x) + k((x) - (x) T ), 

^<p> =-«<*>-£<p>. 


(33) 

(34) 
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These equations are exactly the same as the classical equations in Ref. [30] if 
one considers only position measurements. Hence, we can successfully repro¬ 
duce the classical feedback scheme on average. Unfortunately the treatment 
of delay differential equations is very complicated and our goal is not to study 
these equations in detail now. However, the reasoning why we can turn a sta¬ 
ble fixed point into an unstable one goes like this: for k = 0 we clearly have 
a stable fixed point but for fc > k we might neglect the term — f (x) for a 
moment. If we choose t = tt/oj (corresponding to half of a period of the un¬ 
damped HO), we see that the “feedback force” k({x) — (x) T ) is always positive 
if ( x) > 0 and negative if (x) < 0 (we assume k > 0). Hence, by looking at the 
differential equation it follows that the feedback term generates a drift “out¬ 
wards”, i.e., away from the fixed point (0, 0), which at some point also cannot 
be compensated anymore by the friction of the momentum — ^ (p). From the 
numerics, see Fig. 2, we infer that the critical feedback strength, which turns 
the stable fixed point into an unstable one is k > §, also see Ref. [30] for a 
more detailed discussion of the domain of control. 


k = 0.03 k = 0.05 k = 0.07 



Fig. 2. Parametric plot of ({x), (p))(t) as a function of time t £ [0,20] for dif¬ 
ferent feedback strengths k based on Eqs. (33) and (34). The initial condition is 
((*), (p))(t) = (1,0) for t < 0 and the other parameters are w = 1 ,k = 0.1 and 
r = 7T. Note that the trajectory for k = k is not a perfect circle due to the asym¬ 
metric feedback, which is only applied to the ^-coordinate and not to p. 


Turning to the time evolution of the conditional covariances we obtain 4 

4 Pay attention to the fact that we are using an Ito stochastic differential equation 
where the ordinary chain rule of differentiation does not apply. Instead, we have 
for instance for the stochastic change of the position variance dV x ,c = d(x * 2 ) c — 

2 (x) c d(x) c - (d(x) J 2 . 
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(35) 


(36) 


(37) 


Unfortunately, we see that all the stochastic terms proportional to dW involve 
third order cumulants, which would in turn require to deduce equations for 
them as well. However, if we assume that the state of our system is Gaussian, 
these terms vanish due to the fact that third order cumulants of a Gaussian 
are zero. In fact, the assumption of a Gaussian state seems reasonable 5 : first 
of all, if the system is already Gaussian, it will also remain Gaussian for all 
times, because then the Eqs. (31) and (32) as well as Eqs. (35) - (37) form a 
closed set. Second, even if we start with a non-Gaussian distribution, the state 
is expected to rapidly evolve to a Gaussian due to the continuous position 
measurement and the environmentally induced decoherence and dissipation 
[44] . Then, the time evolution of the conditional covariances becomes indeed 
deterministic, i.e., the covariances (but not the means) behave identically in 
each single realization of the experiment: 



1 + 2 ns 

1 + 2ub hj 
2 h ~2~’ 


(38) 


(39) 


(40) 


Thus, we can fully solve the conditional dynamics of the system by first solving 
the ordinary differential equations for the covariances and then, using this 
solution, we can integrate the stochastic equations (31) and (32) for the means. 

Because the time evolution of the conditional covariances is the same for 
the second feedback scheme, we will discuss them in more detail in Sec. 4. 
Here, we just want to emphasize that we cannot simply average the con¬ 
ditional covariances to obtain the unconditional ones, i.e., E[14 )C ] ^ V x = 

5 We remark that a Gaussian state in QM, i.e., a system described by a Gaussian 
Wigner function, might still exhibit true quantum features like entanglement or 
squeezing [2, 3]. 
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/ dxdpx 2 W(x,p ) — [J dxdpxW(x,p)} 2 in general. In fact, the conditional and 
unconditional covariances can behave very differently, see Sec. 4. 

Finally, let us say a few words about our feedback scheme in comparison 
with the coherent control schemes in Refs. [36, 37, 38, 39, 40, 42, 43], which 
are designed for quantum optical systems and use an external mirror to in¬ 
duce an intrinsic time-delay in the system dynamics. Clearly, the advantage 
of the coherent control schemes is that they do not introduce additional noise, 
because they avoid any explicit measurement. On the other hand, in our feed¬ 
back loop we have the freedom to choose the feedback strength k at our will, 
which allows us to truely reverse the effect of dissipation. In fact, due to simple 
arguments of energy conservation, the coherent control schemes can only fully 
reverse the effect of dissipation if the external mirrors are perfect. Otherwise 
the overall system and controller is still loosing energy at a finite rate such 
that the system ends up in the same steady state as without feedback. Thus, as 
long as the coherent control loop does not have access to any external sources 
of energy, it is only able to counteract dissipation on a transient time-scale 
except one allows for perfect mirrors, which in turn would make it unnessary 
to introduce any feedback loop at all in our situation. It should be noted, 
however, that for transient time-scales coherent feedback might have strong 
advantages or it might be the case that one is not primarily interested in the 
prevention of dissipation (in fact, in Ref. [40] they use the control loop to speed 
up dissipation). The question whether one scheme is superior to the other is 
thus, in general, undecidable and needs a thorough case to case analysis. 

4 Feedback Scheme II 

We wish to present a second feedback scheme, in which we replace the time- 
delayed signal by a fixed reference signal such that no time-delayed noise 
enters the description and hence, we are not forced to work with a SME like 
Eq. (26). The measurement signal we wish to couple back is thus of the form 



(41) 


and our aim is to synchronize the motion of the HO with the external reference 
signal x*(t). Choosing z = kp and using Eq. (15) yields the SME 

p c {t + dt ) = p c (t) 



(42) 
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The associated FPE (22) for the conditional Wigner function is given by 


W c (x,p, t + dt) 


W c {x,p,t)+dt ( — d+-V J D- V ) W c (x,p,t) 


dW(t) 


2777 




W c (x,p,t) 


(43) 


with the nonvanishing coefficients 


d X =uip--x + k[x-x*(t)\, d p = -uix--p, 


D XX - 


2 

1 + 2 TlB 


hk 2 

2777’ 


Dpp = K-h 


1 + 27i B Ay 

2 h " 2 "' 


(44) 


Because we have no time-delayed noise here, the average, unconditional evolu¬ 
tion of the system can be simply obtained by dropping all terms proportional 
to the noise dW(t) due to Eq. (12). We thus have a fully Markovian feedback 
scheme here. 

The equation of motion for the conditional means are 


d(x) c = |w(p) ~^( x ) + k[(x) - x*(t)]| dt (45) 

+ + 

d( J>)c = {-w^) - 77 (p)} dt + \j^-C c d,W{t) (46) 

from which the average evolution directly follows: 

^{x) = u>(p) ~^{x)+ k[{x) - x*(t)], (47) 

^(p) = ~u{x) - |(p). (48) 

Again, it is not our purpose to investigate these equations in detail, but we 
will only focus on the special situation k = k /2 and x*(t) = — 7/0 cos(wt). 
Then, 


(x) = u{p) + cos(wt), (49) 

^(p) = -u(x)-^(p). (50) 

These equations look very similar to the classical differential equation of an 
externally forced harmonic oscillator. 6 However, it is important to emphasize 


Indeed, if we would choose the feedback operator z = kx, the resulting differential 
equations for ( x) and ( p ) would exactly resemble the differential equation of a 
classical harmonic oscillator with sinusoidal driving force. 
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that we do not have an open-loop control scheme here although it looks like 
it at the average level of the means. The asymptotic solution of Eqs. (49) and 
(50) is given by 


lim (x)(t) = yo cos (cot) + —— sin(o;f), (51) 

£—>•00 ZOJ 

lim (p)(t) = —yosin(ujt). (52) 

£—>■00 

Within the weak-coupling regime it is natural to assume that k/w< 1 and we 
asymptotically obtain a circular motion ((x), ( p)){t ) ~ yo(cos tot, — sinwt). It 
is worth to stress that we always reach the asymptotic solution independent of 
the chosen initial condition, also see Fig. 3. As a consequence, the limit cycle 
given by Eqs. (51) and (52) is stable. In contrast, the equations of motion for 
the first scheme are completely scale-invariant, i.e., an arbitrary scaling of the 
form ((x),(p)) = a((x),(p)),a € R, leaves the Eqs. (33) and (34) unchanged 
and the effect of the feedback depends on the initial condition. 


(x)(t) ( p)(t ) 



Fig. 3. Plot of the average mean values (x)(t) and (p)(t) as a function of time t 
(black, thick lines) compared to the asymptotic solution given by Eqs. (51) and (52) 
(red, thin lines). The upper panel corresponds to the initial condition ((x), (p))(0) = 
(1/2,1/2) and the lower one to ((x), (p))(0) = (3,3). Other parameters are uj = 
1, k = 1/4 and yo = 2. 


Within the Gaussian assumption, the conditional covariances (i.e., the 
covariances an observer with access to the measurement result would associate 
to the state of the system) evolve as for the first scheme according to 
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V x _ c — —kVx.c + 2 uC c —V, 2 


d_ 

dt 

~ ^V p ^c 2iuC c 


2 tt? 

h x ’ c 


kH 


1 + 2ns 


2 7?7^2 


ct + 


1 + 2?7b fry 
2 ^ ”2”’ 


^■C c — w(V^, iC — T4 )C ) — kC c — —j—V X}C C c . 


(53) 

(54) 

(55) 


In contrast, the unconditional covariances (which an observer without access 
to the measurement results would associate to the state of the system) obey 


4;V X = (2 k - k)V x + 2wC + nh— 
dt 2 2777 

di t r T _ _ „ ,l + 2ns fty 

— Ip — —kV p — 2ujC + kH ---1——, 

jC = u(V p - 14) + (fc - «)C. 


(56) 

(57) 

(58) 


Comparing both sets of equations, the most striking difference is that Eqs. 
(53) - (55) are nonlinear differential equations whereas Eqs. (56) - (58) are 
linear. Especially note the term proportional to —V^ c in Eq. (53), which 
tends to squeeze the wavepacket in the ^-direction. This is the effect of the 
continuous measurement performed on the system, which tends to localize the 
state. However, if we average over (or, equivalently, ignore) the measurement 
results, this effect is missing. Furthermore, note that Eqs. (53) - (55) do 
not contain the parameter fc, which quantifies how strongly we feed back the 
signal. 

Solving Eqs. (53) - (55) for its steady state is possible, but the exact 
expressions are extremely lengthy. However, to see how the continuous mea¬ 
surement influences the conditional covariances we will have a look at the 
special case of no damping (k = 0). To appreciate this case we remind us 
that the steady state covariances of a damped HO for no measurement and 
no feedback are given by V x = V p = h(n,B + 5) and C = 0. 7 Especially, at zero 
temperature (ns =0), we have a minimum uncertainty wave packet satisfying 
the lower bound of the Heisenberg uncertainty relation, V X V P = h?/ 4. Now, 
for k = 0, we can expand the conditional covariances in powers of 7: 


lim V x Jt) 

t—t OO 


lim V p , c (t) 

)—»oo 

lim C c {t) 


h _ a/t?^7 2 

2yjr\ 16w 2 


h syyh'y 2 

2 y/rj + 16w 2 




0 { 7 3 ), 
7 3 ), 


(59) 

(60) 
(61) 


7 We can obtain this result by computing the steady state of Eqs. (56) - (58) where 
we first send k —► 0 and then 7 —» 0 . 
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We see that the uncertainty in position is reduced at the expense of an in¬ 
creased uncertainty in momentum. This is exactly what we have to expect 
from a position measurement due to Heisenberg’s uncertainty principle. Note 
that this effect is weakened for larger frequencies ui of the oscillator, because 
the continuous measurement has problems to “follow” the state appropriately. 
Furthermore, an imperfect detector (77 < 1) will always increase the variances. 
Finally, we remark that these results become meaningless in the strict limit 
7 —^ 0 , because in that case there is simply no conditional dynamics. This 
becomes also clear by looking at Eq. (56), in which the last term diverges in 
this limit, because we would feed back an infinitely noisy signal. 

Thus, an observer with access to the measurement record would associate 
very different covariances to the system in comparison to an observer without 
that knowledge. However, a detailed discussion of the time evolution of the 
covariances is beyond the scope of the present paper. Instead, we find it more 
interesting to discuss the relationship between the present quantum feedback 
scheme and its classical counterpart, to which we turn now. 


5 Classical limit 


To take the classical limit in our case we have to use a little trick, because 
simply taking H —> 0 does not yield the correct result. In fact, for h —> 0 we 
have from Eq. ( 8 ) that I(t) = ( x) c (t ), which only makes sense if we can observe 
the particle with infinite accuracy, i.e., its conditional probability distribution 
is a delta function with respect to the position x. We explicitly wish, however, 
to model a noisy classical measurement. We thus additionally demand that 
77 —> 0. More specifically, we set 77 = fi/cr with a finite such that Eq. ( 8 ) 
becomes 


dl{t) 


(x) c (t)dt 



(62) 


and we remark that the case a —> 0 corresponds to an error-free measurement. 

The FPE (22) for the free evolution of the HO with drift vector and dif¬ 
fusion matrix from Eq. (23) becomes for h —> 0 (note that the Bose-Einstein 
distribution ub contains h as well and needs to be expanded) 




CoP{x,p,t) 




P(x,p,t). 


(63) 


To emphasize the fact that the Wigner function W(x,p) becomes an ordinary 
probability distribution in the classical limit, we denoted it by P(x,p). As 
expected, we see that Eq. (63) corresponds to a FPE for a Brownian particle in 
a harmonic potential where position and momentum are both damped (usually 
one considers only the momentum to be damped [29]). This peculiarity is 
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a consequence of an approximation made in deriving the ME (1), which is 
known as the secular or rotating-wave approximation. Nevertheless, one easily 
confirms that the canonical equilibrium state P eq ~ exp[— /3oj(p 2 +x 2 )/2] is a 
steady state of this FPE as it must be. 

Next, it turns out to be interesting to discuss the classical limit of the 
SME (13) describing the free evolution plus the influence of the continuous 
noisy measurement. Using Eq. (24) we obtain an equation for the conditional 
probability distribution P c (x,p ) 


P c (x,p, t + dt) 



(x) c )dW(t) 


P c (x,p,t). 


(64) 


This is a stochastic FPE, which is nonlinear in P c . It describes how our state 
of knowledge changes if we take into account the measurement record (62). 
However, averaging Eq. (64) over all measurement results yields Eq. (63), 
which reflects the fact that a classical measurement does not perturb the 
system. 8 This is in contrast to the quantum case where the average evolution 
is still influenced by £ mea s, see Eq. (6). Hence, the term £ meas in Eq. (6) 
is purely of quantum orgin and it describes the effect of decoherence on a 
quantum state under the influence of a measurement. This effect is absent in 
a classical world. Exactly the same equation and the same conclusions were 
already derived by Milburn following a different route [45]. 

The impact of these conclusions is, however, much more severe if one addi¬ 
tionally considers feedback. As we will now show, applying feedback based on 
the use of the stochastic FPE (64), does indeed yield observable consequences 
even on average. Please note that trying to model the present situation by a 
classical Langevin equation is nonsensical. If we would use a Langevin equa¬ 
tion to describe our state of knowlegde about the system, we would implicitly 
ascribe an objective reality to the fact that there is a definite position Xq 
and momentum po of the particle corresponding to a probability distribution 
6(x — xo)6(p — po). This is, however, not true from the point of view of the 
observer who has to apply feedback control based on incomplete information 
(i.e., the noisy measurement record). Results we would obtain from a Langevin 
equation treatment can only be recovered in the limit of an error-free mea¬ 
surement, i.e., for o —y 0, as we will demonstrate in appendix A. 

For simplicity we will only have a look at the second feedback scheme 
from Sec. 4, because we can directly obtain the classical limit for the average 
evolution from Eq. (43). The same situation is, however, also encountered 
by considering the first scheme. Taking h —> 0 in Eq. (43) together with the 
coefficients (44) then yields the FPE 

^P(x,p,t) = {/£ - d x k[x - x*(t)] + P(x,P,t). (65) 


This is true at least in our context. In principle, it is of course possible to construct 
classical measurements, which perturb the system, too [6]. 
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The first term to the correction of C g 1 is the term one would expect for a 
noiseless feedback loop, too. The second, however, only arises due to the noisy 
measurement (we see that it vanishes for er —> 0) and causes an additional 
diffusion in the x direction simply due to the fact that the observer applies a 
slightly wrong feedback control compared to the “perfect” situation without 
measurement errors. 

We thus conclude this section by noting that the treatment of continu¬ 
ous noisy classical measurements faces similar challenges as in the quantum 
setting. On average the measurement itself does not influence the classical 
dynamics, but we see that we obtain new terms even on average if we use 
this measurement to perform feedback control. Most importantly, because a 
feedback loop has to be implemented by the observer who has access to the 
measurement record, it is in general not possible to model this situation with 
a Langevin equation. Furthermore, we remark that the situation is expected 
to be even more complicated for time-delayed feedback, where no average 
description is a priori possible. 


6 Summary and outlook 

Because we discussed the meaning of our results already during the main text 
in detail, we will only give a short summary together with a discussion on 
possible extensions and applications. 

We have used two simple feedback schemes, which are known to change the 
stability of a steady state obtained from linearizing a dynamical system around 
that fixed point in the classical case. For the simple situation of a damped 
quantum HO we have seen that on average we obtain the same dynamics for 
the mean values as expected from a classical treatment and thus, classical 
control strategies might turn out to be very useful in the quantum realm, too. 

However, the fact that a classical control scheme works so well in the quan¬ 
tum regime depends on two crucial assumptions. First of all, we have used 
a linear system (the HO). Having a non-linear system Hamiltonian (e.g., a 
Hamiltonian with a quartic potential ~ i 4 ) would complicate the treatment, 
because already the equations for the mean values would contain higher order 
moments, as e.g. ( x 3 ) in case of the quartic oscillator. Simply factorizing them 
as (x 3 ) ~ (x) would imply that we are already using a classical approxima¬ 
tion. However, as in the classical treatment, where the equations of motion are 
obtained from linearizing a (potentially non-linear) dynamical system around 
the fixed point, it might also be possible in the quantum regime to neglect 
non-linear terms in the vicinity of the fixed point. Whether or not this is possi¬ 
ble crucially depends on the localization of the state in phase space, i.e., on its 
covariances. Here, continuous quantum measurements can actually turn out 
to be helpful, because they tend to localize the wavefunction and counteract 
a possible spreading of the state. 
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The second important assumption we used was that we restricted ourselves 
to continuous variable quantum systems. The reason why we obtained simple 
equations of motion is related to the commutation relation [x,p] = ih , which 
we implicitly used to obtain the evolution equation for the Wigner function. 
Formally, phase space methods are also possible for other quantum systems, 
but the maps are much more complicated [27]. For such systems the meth¬ 
ods presented here might be useful under certain special assumptions, but in 
general one should expect them to fail. 
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A Appendix 

We want to show that the stochastic FPE, which in general describes the in¬ 
complete state of knowledge of an observer, reduces to a Langevin equation in 


Title Suppressed Due to Excessive Length 


23 


the error-free limit, i.e., in the limit in which we have indeed complete knowl¬ 
edge about the state of the system. Because we are only interested in a proof 
of principle here, we will consider the simplified situation of an overdamped 
particle. 9 The Langevin equation of an overdamped Brownian particle in an 
external potential U(x) is usually given as (see, e.g., [29]) 


x(t ) = - -U'{x) + \/^-£(t) (66) 

k V K 

with 17'(x) = c)U q^ and the Gaussian white noise £(f) = . Furthermore, 

note that our friction constant is ^ and not - as it is often denoted - 7, 
because we use 7 already for the measurement rate. Now, it is important to 
remark that at this point Eq. (66) simply describes a convenient numerical 
tool to simulate a stochastic process. By the mathematical rules of stochastic 
calculus it is guaranteed that the Langevin equation gives the same averages 
as the corresponding FPE, i.e., the ensemble average E[/(x)] over all noisy 
trajectories for some function /(x) is equal to the expectation value (/(x)) 
taken with respect to the solution of the FPE. 

In Sec. 5 we have suggested that the correct state of the system based on 
a noisy position measurement is given by the stochastic FPE (64), which for 
an overdamped particle becomes (see also Ref. [45]) 


P c (x,t + dt) 



{■x) c )dW(t ) > P c {x,t) 


(67) 


with [29] 

rd = ( W(?) , l_2T\ 

0 dx \ k dx k J 


( 68 ) 


Furthermore, we have also claimed that the parameter a in (62) quantifies 
the error of the measurement. This suggests that we should be able to recover 
the Langevin Eq. (66) in the limit a —> 0 in which we can observe the particle 
with infinite precision. 

To show this we compute the expectation value of the position according 
to Eq. (67): 

d(x) c (t) = ——(U'{x)) c dt + \ —V c {t)dW(t) (69) 

Kj V (T 

where V c = {x 2 ) c — {x) 2 c denotes the variance of the particles position. Because 
the conditional variance enters this equation, we compute its time evolution, 
too: 

9 The complete description of an underdamped particle (i.e., a particle descibed by 
its position x and momentum p), which is based on a continuous measurement of 
its position x alone, Eq. (62), faces the additional challenge that we have to first 
estimate the momentum p based on the noisy measurement results. 






24 


Philipp Strasberg, Gernot Schaller, and Tobias Brandes 

4 4T I'y 

dVc = ~- [{xU\x)) c (t) - (x) c (t)(U'(x))M dt + —dt - -^V 2 dt 

rv rx (J 

+ ( x )c( t )] 3 ) dW ( t )- 


(70) 


To make analytical progress we now need two assumptions. First, we will 
assume that P c (x,t) is a Gaussian probability distribution. In fact, because 
the measurement tends to localize the probability distribution and it is itself 
modeled as a Gaussian process, this assumption seems reasonable. In addition, 
we expect P c {x , t) to become a delta-distribution in the limit a —> 0, which is 
a Gaussian distribution, too. This assumption allows us to drop the stochastic 
term in Eq. (70). Second, within the variance of P c (x,t) we assume that we 
can expand U(x) in a Taylor series and approximate it by a quadratic function 
ax 2 + bx + c. This implies (xU'(x)) c (t) « a(x 2 ) c (t) + b{x) c {t). In fact, this 
assumption seems also reasonable, because we expect the measurement to be 
precise enough such that we can locally resolve the evolution of the particle 
sufficiently well (especially for small a); or to put it differently: a measurement 
only makes sense if the conditional variance V c of P c {x,t) is small enough. 
Using this approximation, too, we can then write Eq. (70) as 


jMt) = y - —Vc - 


(71) 


The only physical steady state solution of this equation is 


lim V c (t) = — 

t-¥ oo yK 


Inserting this into Eq. (69) yields 




d(x) c (t) = ——(U'(x)) dt + - ( ^1 + 

K K V 7 \ V 




(72) 


1 j dW(t). 


(73) 


In this equation we can take the limit a —> 0 such that 


d{x)° c (t) = ——(U'(x))°dt + J—dW(t), (74) 

K V K 

where we introduced a superscript 0 on all expectation values to denote the 
error-free limit. This equation looks already very similar to the LE (66). In 
fact, mathematically this is the LE since from Eq. (62) we can see that the 
measurement result becomes for a 0 dl{t) = {xy c (t)dt. This implies that 
the measurement result is deterministic and not stochastic anymore, which is 
only compatible if the associated probability distribution P c (x,t) is a delta 
distribution S(x — x*) where x* describes the true instantaneous position of 
the particle without any uncertainty. Then, Eq. (69) becomes 
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dx*(t) = ——U'(x*)dt + \ —dW(t). (75) 

k V re 

Now, this equation is not just a numerical tool, but describes real physical 
objectivity , because x* coincides with the observed position in the lab. This 
distinction might seem very nitpicking, but it is of crucial importance if we 
want to perform feedback based on incomplete information. 


